This paper is very well written, nicely motivated and introduces a general principle to design neural network for data with conservation laws using Hamiltonian mechanics. Contrary to what the authors state, including energy conservation into neural networks and optimizing its gradients is now common procedure in this domain, for example: - Pukrittayakamee et al. For classical systems, as presented in this paper, it seems that this addition is rather counter-productive: while the change of momentum is described by the potential (see references above), the change of positions directly follows from the equations of motion and does not require an additional derivative of the network. This is both more computationally efficient and generalizes by design to all initial momenta (provided the corresponding positions stay close to the training manifold). On the other hand, I am not convinced that the proposed architecture would still work when applying a trained model to a different energy level.

A growing body of work leverages the Hamiltonian formalism as an inductive bias for physically plausible neural network based video generation. The structure of the Hamiltonian ensures conservation of a learned quantity (e.g., energy) and imposes a phase-space interpretation on the low-dimensional manifold underlying the input video. While this interpretation has the potential to facilitate the integration of learned representations in downstream tasks, existing methods are limited in their applicability as they require a structural prior for the configuration space at design time. In this work, we present a GAN-based video generation pipeline with a learned configuration space map and Hamiltonian neural network motion model, to learn a representation of the configuration space from data. We train our model with a physics-inspired cyclic-coordinate loss function which encourages a minimal representation of the configuration space and improves interpretability. We demonstrate the efficacy and advantages of our approach on the Hamiltonian Dynamics Suite Toy Physics dataset.